Start 
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Define primitive event types 



4 

Define combinations of the 
primitive event types as a 
compound event type 



I 

Input the primitive event 
occurrences, such occurrences 
being specified as the set of 
temporal intervals over which 
a given primitive event type 
is true, wherein the sets of 
temporal intervals are specified 
as smaller sets of spanning 
intervals, each spanning interval 
representing a set of intervals 



▼ 

Compute the compound event 
occurrences, such occurrences being 
specified as the set of temporal 
intervals over which the compound 
event type is true, wherein the sets 
of temporal intervals are specified 
as smaller sets of spanning intervals, 
each spanning interval representing 
a set of intervals 
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Start 



I 

Label primitive subexpressions of <I> 
with spanning intervals that represent 
the sets of intervals over which the 



inning niLciviiis uiai icpicacj 

the sets of intervals over which the 
►rresponding primitive event types hold 



CO] 



Are there any 
subexpressions that 
have not been labeled 
with sets of spanning 
intervals? 



No 



Stop: output the set 
of spanning intervals 
that label the whole 
(root) expression O 



Yes 



Let O' be some subexpression of O 
such that O'is not labeled with sets of 
spanning intervals but for which all 
subexpressions O J ofO' 
are labeled with sets of spanning intervals 



FIG. 2 



i 

Apply the appropriate formula for 
s (M, O') using the subroutines < i ) , 
i] n 12, Span (11,12) ,3)(r,i) , 
and 5(i/J) to compute a set of 
spanning intervals to label O' 



X = y — X = y 



Supported(x) = -.Grounded(x) 
Rigidly ATTACHED(x,y) = (3r)RiGiD(x, y,r) 



, . A / -GROUNDED(y)A ^ 
SUPPORTS(x.y) - ^ ^STABLE(P\{x},MU{GROUNDED(z)hRlGIDLYATTACHED*(2,y)}) J 

CONTACTS(x, y) = TOUCHES(x, y) A X Cx] y 



AttaCHED(x, y) = {3r)RlGID(x, y, r) V Revolute(x, y, r) 



FIG. 3 



PlCKUp(a:,y, z) = 



PuTDoWN(x,y, z) = 



STACK(t£;,x,y,z) 
Unstack(u;,x,t/,2;) 

MovE(ur,x,y,z) 
AsSEMBLE(ti;, x, y , z) 
DlSASSEMBLE(ti;, X, y , z) 



I -lOx ~yt\ -^Oz = X A ~^<>z — yt\ \ 
SuppoRTED(y) A ->0 Attached (x, z)N 

-,OAttached(x, y) A -'OSuPPORTS(x, y) A 
SUPP0RTS(2,y)A , 

-•OSuPPORTEDCx) A -«OATTACHED(y, z)A 
-'OSUPPORTS(y, x) A -iOSUPPORTS(y, 2) A 
-<OSUPPORTS(x,2) A -^OSUPPORTS(z,x) 
[AtTACHED(x, y) V ATTACHED(y, z)\ \ 

~ Attached(x, y) A Supports(x, y)A 
-iOSuPPORTS(z, y)A 

-'OSUPPORTED(x) a -'OATTACHED(y, z)/\ 
-.OSuPPORTS(y,x) A ->OSuPPORTS(y, 2)A 
\ I L "^OSUPPORTS(x,z) A -^OSUPPORTS(z,x) J ) ) 

( -^Ox — y f\ -lOz = X A -lOz = yA \ 
SUPPORTED(y) A ->OATTACHED{x, 2)A 

ATTACHED(x, y) A SUPPORTS(x, y)A 
-•OSUPPORTS(z, y)A 

-«OSUPPORTED(x) a ->OATTACHED(y, z) A 
-«OSuPPORTS(y, x) A -•OSuPPORTS{y, z) A 
_ -»OStJPPORTS(x,z) A -.OSUPPORTS(z,x) 
[Attached(x, y) V ATTACHED(y, z)] ; 
' -•OAtTACHED(x, y) A -iOSUPPORTS(x, y) A 
SUPPORTS(z,y)A 

--OSuPPORTED(x) a -«OATTACHED(y, z)A 
-•OSUPPORTS(y,x) A ->OSUPPORTS(y,z)A 

V I L ~''^'^^^^*^^'^^(^'^) ^ ~'^^^^^*^^'^^('^'^) J J / 
->Oz = w A ->Oz = X A -«02 = yA 
PUTDowN(ii;,x,y) A SuPPORTS(z, y) A -nATTACHED(z, y) 

-«02 — w A -»Oz — X A ~*Oz = yA 

PickUp(u;, X, y) A SuPPORTS(z, y) A -'AttacHED(z, y) 
-lOy = z A [PlCKUp(it;, x, y); PutDown(ui, x, z)] 
PutDown(u;, y, z) A(<} Stack(i(;, x, y, z) 
UNSTACK(ii;, x,y,z) A{<j PickUp(x, y,z) 



FIG. 4 



(PICK-UP MOVING RED CREEN)<B{ttO, 1} . [14.223 )> 

(SUPPORTED? RED) «{[ [0:22])} 
(SUPPORTED? MOVING) Oil [1:13]), [[24:26])} 
(SUPPORTS? RED MOVINC)«{ttl : 13]) . [[24:26])} 
(SUPPORTS? MOVING RED)«{ [[13 : 22] ) } 
(SUPPORTS? GREEN RED)(0{ [ [0: 14] ) } 
(SUPPORTS? GREEN M0VING)0{[[1 : 13] )} 
(CONTACTS? RED GREEN) «<[ [0:2]), [[6:14])} 
(ATTACHED? RED MOVING) «{[(!: 26])} 
(ATTACHED? RED GREEN)«{ [ [l : 6] )} 



(PUT-DOWN MOVING RED GREEN) <D<[[0, 14] , [23,32])} 

(SUPPORTED? MOVING) ©{[[14: 23])} 
(SUPPORTED? RED)fl{[[0:32])} 
(SUPPORTS? MOVING RED)0{[[0: 14] )} 
(SUPPORTS? RED MOVING) «{[ [14: 23] )} 
(SUPPORTS? GREEN MOVING)«{ [[14: 23] )} 
(SUPPORTS? GREEN RED)ffl{[[l4:32] )} 
(CONTACTS? RED GREEN) «<[ [22:32] ) } 
(ATTACHED? MOVING RED) fi{ [ [0:23] )} 
(ATTACHED? RED GREEN)«< [ [14: 22] ) } 



FIG 6A 



FIG 6B 





s 

2 




o 
B 




i 




I 





s 

eg 




eg 




CM 
CO 



eg 




<m-DOVN MOVING RED BLUE) «{[tO, 12) . [24.30]) ) 
(STACK KOVIWG RED BLUE CREEII)«{ t [0, 12] , t24, 30) )} 

(SUPPORTED? H0VIKG)«{[[13:241)> 

(SUPPORTED? RED)«<[tO:30))} 

(SUPPORTED? BLUE)e{[tO:30))> 

(SUPPORTS? MOVING RED)«<t tO: 12) ) ) 

(SUPPORTS? RED HOVI KG) «{ t C 13 : 24) ) } 

(SUPPORTS? RED BLUE)e{Ctl9 :20)> . tt21:22))} 

(SUPPORTS? CREEK M0VIHC)e{ttl9:2O]) , Cl2l:22l)} 

(SUPPORTS? GREEN RED)C< [tl9:20) ) , tt2l:22]>> 

(SUPPORTS? GREEN BLUE)«(t[0:30))) 

(SUPPORTS? BLUE MOVIKC)«{ CC13:24) )> 

(SUPPORTS? BLUE RED)«<ttl2:30))> 

(COmCTS? RED BLUE)«{[{12:19)), (t20:2lj). t[22:30))} 
(CONTACTS? CREEH BLUE)«{[ [0:30) )> 
(ATTACHED? MOVING RED)«([ [0:24) )) 
(ATTACHED? RED BLUE) •{ [[19:20] ) . [[21:22))) 



FIG 8A 



(PICK-UP MOVING RED BLUE)«{ [ [0, 11] , [25 .33) ) > 
(UNSTACK MOVING RED BLUE CREEK)«{ t [0, 1 1) . (25.33) ) ) 

(SUPPORTED? M0VINC)«{((11:23])} 
(SUPPORTED? RED)€{([0:36))> 
(SUPPORTED? BLUE)«{[[0:36])> 
(SUPPORTS? MOVING RED)C([C23:36] )> 
(SUPPORTS? RED MOVING) «{( [11 : 23] ) > 
(SUPPORTS? RED BLUE)C<((13: 14))> 
(SUPPORTS? GREEN MOVING) •{[( 13: 14) ) > 
(SUPPORTS? GREEN RED)€<[[13: 14))} 
(SUPPORTS? GREEN BLUE) C< ( [0 : 36) ) ) 
(SUPPORTS? BLUE MOVING) «([ [11: 23) )> 
(SUPPORTS? BLUE RED)0{ [[0:2SJ )} 
(CONTACTS? MOVING RED)«{[(34:36))> 
(CONTACTS? RED BLUE)fl( ([0: 13) ) , [tl4:24))> 
(CONTACTS? GREEN BLUE)«{ (tO: 13]) , [[14:36])} 
(ATTACHED? MOVING RED) 0{ ( [It :33] ) ) 
(ATTACHED? RED BLUE)C( [[13; 14) )} 
(ATTACHED? GREEN BLUE)e{ [(13: 14] )> 



FIG. 8B 



(PICK-UP MOVING RED GREEN) €< [(0,9) , [17. 46) ) } 
(PUT-DOWN MOVING RED BLUE) «{ ((17.35) . [46 ,52] )} 
(MOVE MOVING RED GREEN BLUE) «{((0. 9] , [46,52] )} 

(SUPPORTED? M0VING)e<[[9:15))} 
(SUPPORTED? RED)«{((0:S2))> 
(SUPPORTED? BLUE) «{ ([35:46])} 
(SUPPORTS? MOVING RED) €{[[17: 46) ) } 
(SUPPORTS? MOVING BLUE) €{([35: 46] )> 
(SUPPORTS? RED MOVING) €{[(9: 15) )} 
(SUPPORTS? RED BLUE)fl{ ((35: 46]) } 
(SUPPORTS? CREEH M0VING)«{[t9: IS) )) 
(SUPPORTS? CREEH RED)e{ ( [0: 17))> 
(SUPPORTS? BLUE RED) €{ ([46:52) )> 
(CONTACTS? RED GREEN) «{[[0: 17))} 
(CONTACTS? RED BLUE) €{ ([46:52) ) } 
(ATTACHED? MOVING RED)«{((9:46))} 
(ATTACHED? RED BLUE) •{ ([35:46] ) } 



FIG 8C 



(PUT-OOVH MOVING RED GREEM)«{ ([57 .68] , (68.87) )} 
(PUT-DOVN MOVING GREEN BLUE)0{ ( [18,35] . (41 ,47] )} 
(STACK MOVING RED GREEN BLUE) 0{[ [57, 68] , (68.87))} 
(ASSEMBLE MOVING RED GREEN BLUE) €{(( 18.35) , (68,87) )} 

(SUPPORTED? MOVIHG)«{([10:18]) , [[47:57])} 
(SUPPORTED? RED)«{ [[57:87])} 
(SUPPORTED? CR£EN)«{[ [11:87])} 
(SUPPORTED? BLUE)«{[(3S:41))} 
(SUPPORTS? MOVING RED)«{[ (57 : 68] ) } 
(SUPPORTS? MOVING CREEK)0{{(11 :4l])} 
(SUPPORTS? MOVING BLUE)«{ [[35 :4l] ) } 
(SUPPORTS? RED MOVIKG)«{[ [10: 18]) . ((47:57))} 
(SUPPORTS? RED CREEN)«{ [[it: 16] )} 
(SUPPORTS? GREEN RED) •{ [[68:87] ) } 
(SUPPORTS? GREEN BLUE)C{( (35 : 41] ) } 
(SUPPORTS? BLUE CREEN)«{([4t:87) )) 
(CONTACTS? RED GREEN) 0{ ((68:87) )) 
(CONTACTS? GREEN BLUE)«{ ([41 :87])} 
(ATTACHED? MOVING RED)«{((11 : 16]) , ([49:68])} 
(ATTACHED? MOVING GREEN)e{((ll:4l] )} 
(ATTACHED? GREEN BLUE)C{( [35 : 41) )} 



FIG 8D 



(PICK~UP MOVING RED GREEN) C{ [ (0. 19] , [23.50] )} 
(PICK-UP MOVING GREEN BLUE)e{ ([22.58] . [62.87])} 
(UNSTACK MOVING RED CREEN BLUE) e{([0, 19) . [23,50])) 
(DISASSEMBLE MOVING RED GREEN 8LUE)«{((0,19) , (62,8?])} 

(SUPPORTED? M0VINC)«{([19:22))} 
(SUPPORTED? RED) «{ ([0:50])} 
(SUPPORTED? CREEN) «{ ( (0 :87) ) } 
(SUPPORTED? BLUE)«{((58:62))} 
(SUPPORTS? MOVING RED) €{( (23:50) )} 
(SUPPORTS? MOVING CREEH) •{[[58: 87] ) } 
(SUPPORTS? MOVING BLUE) «{ ((58:62))} 
(SUPPORTS? RED M0VING)«{[[19:22] )} 
(SUPPORTS? GREEN MOVING) «{ [[19: 22) )} 
(SUPPORTS? CREEN RED) 0{[ (0:23))} 
(SUPPORTS? GREEN BLUE)C{ [ [S8:62) )} 
(SUPPORTS? BLUE GREEN) e{ ( (0:58) ) } 
(CONTACTS? RED CREEN)«{[(0:23l)} 
(CONTACTS? GREEN BLUE)C([(0:S8) ) } 
(ATTACHED? MOVING RED) C{[ (19:50) )} 
(ATTACHED? MOVING CREEN) «{ ([58:67) )} 
(ATTACHED? GREEN BLUE)e{( (58:62) )} 



FIG 8E 
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(PICK-UP HOVING RED CREEH)0<CC0.8] . [19,30])} 



(PICK-UP MOVING RED CREEM)0{ ttO, lU . [18,30] )> 

(SUPPORTED? RED)«<(tO:30])> 
(SUPPORTED? CREEN)«{tIll:18])> 
(SUPPORTS? MOVIKC RED)«{ [[11 ;30] )) 
(SUPPORTS? HOVIRG GREEH)e< [[11 : 18] ) > 
(SUPPORTS? RED CREEN)0{([11:18]» 
(SUPPORTS? GREEN RED)«{ ([0: 11] )) 
CC0KTACTS7 RED GREER)e{t[0:ll])> 
(ATTACHED? HOVIKG RED)«{[ [11:30])} 
(ATTACHED? RED GREEN)«{ [ [11 : 18] )} 



(SUPPORTED? H0VlNC)«{[t8:19])} 
(SUPPORTED? RED)«([[0:30])} 
(SUPPORTED? BLUE) €{ [ [0 : 30] ) } 
(SUPPORTS? MOVINC RED)«{ [[19: 30] )} 
(SUPPORTS? RED M0nHG)«{[[8:19])} 
(SUPPORTS? GREEN HOVIHG)«< [ [8 : 19] )} 
(SUPPORTS? GREEK RED)fl< [[0: 19] )} 
(SUPPORTS? YELLOW BLUE) «{ [ [0 : 30] ) > 
(CONTACTS? RED CREEK) •{[[0:10] ), [[16:19])} 
(CONTACTS? BLUE TELU)W)«{C[0: 30])} 
(ATTACHED? MOVING RED) 0{[ [8:30])} 
(ATTACHED? RED CREEN)«< [ [10: 16] ) } 



FIG. lOA 



FIG. lOB 



(PICK-UP MOVING RED CREEN)0{ [[52,70] . [78,102]) . [[0 . 9] , [19.44] ) ) 
(PUT-DOWN MOVINC RED GREEN) «<[[ 19. 44] , [52.70]) . [[78,102] , [110, 117])} 

(SUPPORTED? M0VINC)«{[[9:18]). ([44:52] >, ([70:77]). ([102: 110] )> 
(SUPPORTED? RED) «{[ [0:117])} 

(SUPPORTS? MOVING RED) «{( (18: 44]), [[78:102])} 

(SUPPORTS? RED H0VING)«{[(9:18]). ([44:52]), ([70:77]), [(102:110])} 
(SUPPORTS? CREEK MOVIMC)«<( (9: 18]). [[44:52]), ([70:77]), [[102:110])} 
(SUPPORTS? GREEN RED)«<([0: 19]) . [[44:78]). ((102:117])} 
(CONTACTS? RED GREEN)«{[(0:9]), ((13:181), ([46:70]), ([106:117])} 
(ATTACHED? MOVING RED)«<([9:52]) . [[70:110])} 
(ATTACHED? RED CREEN)«{[ [9: 13]), [[70:76]), [[104:106])} 



(PICK-UP MOVING RED GREEN) «{[ (0,6] , (16,22] )} 
(PICK-UP MOVINC YELLOW BLUE) €{[ (0. 12] , (17.22])} 

(SUPPORTED? M0VINC)«(([6:16])} 
(SUPPORTED? MOVING) «{( (12: IS])) 
(SUPPORTED? RED) fl{ ( [0 : 22] ) } 
(SUPPORTED? YELLOW) «<( [0:22])} 
(SUPPORTS? MOVIKC RED)e{ [ [16: 22] )} 
(SUPPORTS? MOVING YELLOW) •{ [[17 : 22] )} 
(SUPPORTS? RED MOVING) «{( [6: 16])} 
(SUPPORTS? GREEN M0VIKC)«{[[6 : 16])} 
(SUPPORTS? GREEN RED) «{ [ [0 : 16] ) } 
(SUPPORTS? BLUE MOVING) «<[ [12 : IS] ) } 
(SUPPORTS? BLUE YELLOW) 0{ [[0:17])} 
(SUPPORTS? YELLOW MOVINC) •{ [(12: IS] )} 
(CONTACTS? RED GREEN) «{( [0: IS] )} 
(CONTACTS? BLUE YELLOW) «{ [(0: 17] )} 
(ATTACHED? MOVIKC RED) 0{ [[6:22])} 
(ATTACHED? MOVING YELLOW) 0{ [ [12 : 22] )} 



FIG. IOC 



FIG. lOD 



(SUPPORTED? RED)0{[[0:25])> 
(SUPPORTED? GREEN)«<tt7:13])} 
(SUPPORTS? MOVING RED)C< [£?: X33 )} 
(SUPPORTS? MOVING CREEN)«<[t7: 13) )} 
(SUPPORTS? RED CREEH)<B< ( [7: 13) ) } 
(SUPPORTS? GREEN RED)«{ [ [0:7] ) , ([13:25])} 
(CONTACTS? RED GREEN) «< [[0:7] ) , [[13:25])} 
(ATTACHED? MOVING RED)«{ [[7: 13] )} 
(ATTACHED? RED GREEH)«< [[7: 13] ) ) 



(SUPPORTED? RED)«{[(0:19])} 
(SUPPORTED? MOVING)<D{ [[13:31])} 
(SUPPORTS? RED MOVING) «{ [[13:31] )} 
(SUPPORTS? MOVING RED) «{ [ [0 : 13] ) } 
(SUPPORTS? GREEN RED)«{[ [12: 19] )} 
(SUPPORTS? GREEN MOVING) «{[ [13: 19] )} 
(ATTACHED? RED MOVING) <8{ [[0:31] )} 
(ATTACHED? RED GREEN) [ [13: 19] ) } 



FIG. 12A 



FIG 12B 



